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rnMPACT MULTIPLE AP ERTURE IMAGING ARRAY 

FIELD OF THE INVENTION 

The invention relates generally to a method of using an array of 
5 lens elements to capture images. More specifically, the invention relates to a 
method of reducing the volume of the light captured by an array of lens elements 
and combining the image information from the lens elements to form an image 
with a higher resolution than possible with an image captured from a single lens 
element. 

! 0 BACKGROUND OF THE INVENTION 

Conventional imaging systems, such as photographic cameras and 
video cameras, can be reduced in size by miniaturizing the components that comprise 
the imaging systems. This method of constructing smaller and more compact imaging 
systems is inherently limited by the capability of manufacturing and assembling 
1 5 smaller components. In general, as imaging systems are reduced in size, the resolving 
capability of the imaging systems are also reduced. 

Resolution determines the highest amount of image detail that can be 
captured in a scene and is fundamentally limited by the aperture size of the optical 
system (see totaadugtjon to Fourier Ontics by Joseph W. Goodman, McGraw-Hill 
20 Electrical and Computer Engineering Series, second edition, 1996, pp. 134-144). One 
calculation of resolution relates the aperture size to the highest nonzero spatial 
frequency of the modulation transfer function (MTF). An imaging system with a 
smaller aperture size, therefore, will capture images at lower resolution than an 
imaging system with a larger aperture size. 
25 European Patent Application No. 1 079 613, by Jun Tanida et al. 

filed August 18, 2000, titled "IMAGE INPUT APPARATUS" uses an array of 
lenses to form a compact imaging system. The method of Tanida et al. uses a 
partitioned wall layer between the array of lenses and a photosensitive element 
array to form an image. The resolution of the images collected by Tanida et al. is 
30 limited to the size of the individual lenses because Tanida et al. do not disclose a 
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method of relaying all of the light captured by the array of lenses onto one 

photosensitive element. 

A plurality of imaging elements can be combined in geometrical 

patterns to form a larger aperture that can capture an image with a higher 
resolution than possible with an image captured from a single imaging element. 
Multiple aperture system concepts, that coherently combine the light collected 
from a plurality of apertures to form a higher resolution image, have been 
disclosed in prior art. U.S. Patent No. 5,905,591, issued May 18, 1999, to Alan L. 
Duncan et al., titled "MULTI-APERTURE IMAGING SYSTEM," uses multiple 
telescopes to synthesize a larger aperture for a space-based deployable imaging 
system. In another example, U.S. Patent No. 5,919,128, .ssued July 6, 1999, to 
Joseph P. Fitch, titled "SPARSE APERTURE ENDOSCOPE," combines fiber 
optic light pipes to form an endoscope. 

There is a need, therefore, for a compact imaging system using a 
5 plurality of apertures that can potentially capture an image resolution comparable 

to that of a large single aperture. 

SUMMARY OF THE INVENTION 

The aforementioned need is met, according to the present 

invention, by providing a multiple aperture imaging system, that includes: an array 

>0 of lens elements for capturing light; a means for adjusting the optical phase of the 

light a means for reducing the area of the exiting light bundles from the lens 

elements, and a means for combing the captured light within the array of lens 

elements to form an image. 

ADVANTAGEOUS EFFECT OF THE INVENTION 
25 This invention uses an array of lens elements to form a compact 

imaging system that produces an image with higher resolution than possible from 
any individual lens element within the array of lens elements. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The above and other objects, features, and advantages of the 
30 present invention will become more apparent when taken in conjunction with the 
following description and drawings. 
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FIG. la is a schematic diagram illustrating a system that square-packs 
sixteen lens elements with circular apertures to form a square array; 

FIG. lb is a schematic diagram illustrating a system that hexagonally- 
packs twenty lens elements with circular apertures to form a rectangular array; 
5 ' FIG. 1c is a schematic diagram illustrating a system that square-packs 

sixteen lens elements with circular apertures to form a sparse square array; 

FIG. 2 is a perspective view of the light path through two adjacent lens 

elements; 

FIG. 3 is a schematic diagram illustrating one embodiment of the lens 

10 element design; 

FIG 4a is a schematic diagram illustrating the positioning of two 
neighboring optical elements in the horizontal OVRP to reduce the area covering the 

exiting light bundles; 

FIG. 4b is a schematic diagram illustrating the positioning of two 

1 5 neighboring optical elements in the vertical OVRP to reduce the horizontal 
dimension; 

FIG.5 is a schematic diagram illustrating the reduction of the area 

covering the exiting light bundles; 

FIG.6a is a schematic top view of the imaging system design of the 

20 present invention; and 

FIG.6b is a schematic front view of the imaging system design of 

the present invention. 

To facilitate understanding, identical reference numerals have been 

used, where possible, to designate identical elements that are common to the 
25 figures. 

DETAILED DESCRIPTION OF THE INVENTION 

In a method for imaging using multiple apertures, the present 
invention employs an array of lens elements, a means for adjusting the optical 
phase of the light, a means for reducing the area of the light bundles exiting the 
30 lens elements, and a means for combing the captured light within the array of lens 
elements to form an image. The information collected by each lens element can 
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be combined to form an image with higher resolution than possible wtth any 
indtvidual lens element within .he multiple aperture imaging system. Potenttally 
the resolution will correspond to an aperture the size of foe entire .ens artay. 

Referring to one embodiment illustrated in FIG. la, a plural.ty of 
5 tens elements 24 are arranged to form a array of lens elemen«s26 Each lens 
element has an aperture with width d, and foe adjacent horizontal lens elements 
are separated by a cen,er-.o-cen,er separation distance s h ,«he adjacent verttcal lens 
elements are separated by a center-to-center separation distance s„, and the 
adjacent diagonal lens elements are separated by a center-.o-cen.er separation 
,0 distance S„ . The array 26 of lens elements 24 can be arranged to fin. Afferent 
array geometrtes and 1. is understood that the present invention need no. be touted 
to an array of lens elements in a square or rectangular configuration, e.g., areolar, 
elliptical, or hexagonal arrangement of lens elements 24 will also suffice. The 
Urn elements 24 can also be packed together in different configurations other than 
15 square or hexagonal, including ctrcular, elliptical, or non-redundant 

configurations. FIG. la illustrates one embodiment that square-packs stxteen lens 
elements 24 with ctrcular apertures to form a square array 26 of lens elements 24. 
FIG lb illuslrates anofoer embodiment that hexagonally-packs twenty lens 
elements 24 wtth circular apertures to form a rectangular array 26 of lens elements 
20 24 in anofoer embodiment, shown in FIG. 1c, foe lens elements 24 are separated 
further apart to form a sparse aperture square array 26 of lens elements 24. It 
should be need that if 2d<s„ 2d<a., or 2d<s d , .hen .he image quality may no. be 
desirable due to a poor MTF. Other embodiments with non-uniform aperture s.zes 
as well as non-uniform spacing between the apertures could also be considered. 
25 Other lens aperture geometries, other than circular, such as elliptical or rectangular 
aperture shapes, could also be considered. 8 should also be noted that a plurality 
of mirror elements could be used in conjunction with or instead of the plural.ty o, 

lens elements 24. 

Referring to the embodiment illustrated in FIG. la, the sixteen 

30 apertures are square-packed to form an array 26 using four lens elements 24 each 
in the horizontal and vertical directions, such that there are no gaps between the 
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lens elements 24 in the horizontal and vertical directions; hence s h =s v =d. The 
diffraction-limited resolution of each lens element 24 is proportional to the 
diameter d; but if the electromagnetic wavefront propagating from each lens 
element 24 is coherently combined, then a higher resolution can be captured, as if 
collected by a single larger square aperture equal to the size of the array 26. For 
the 4x4 array 26 of lens elements 24 in FIG. la, a resolution correspond to an 
aperturesizeof^x^canbecaptured. For an arbitrary [N h ]x[N v ] rectangular 
array 26 of square-packed lens elements 24, where N h is the number of lens 
element apertures in the horizontal direction and N v is the number of lens element 
apertures in the vertical direction, a higher resolution can be captured 
corresponding to a rectangular aperture with a horizontal length of (N-l)s h + d and 

a vertical width of (N- 1 )s v +d. 

FIG. 2 is a perspective view of the light path through two adjacent 
apertures in one embodiment of the present invention. Incoming light 28 enters 
the lens elements 24 of the imaging system 30. Each lens element 24 reduces the 
dl ameter of the exiting light 32 from each lens element 24 such that the diameter 
d' of the exiting light 32 is smaller than lens element 24 aperture size d. One 
embodiment of the lens elements 24 using a plurality of lenses 34 to reduce the 
diameter of the exiting light bundles is schematically illustrated in FIG. 3. In tins 
20 embodiment, six lenses 34 are used to reduce the scale of the exiting light 32 by a 
factor of 5x. 

Referring to FIG. 2, the light 32 exiting each lens element 24 must 
travel the same optical path length so that the light 32 from each lens element 24 is 
in phase when imaged by the detector 64. A phase corrector 36 corresponding to 
each lens element 24 is implemented to correct the phase differences between the 
light 32 from each lens element 24. It is understood that the phase correction can 
be performed at any point along the light path before reaching the detector 04. 
Phase correction techniques are well established in the art and can be compnsed of 
reflective or transmissive optical elements. In one embodiment, the phase 
corrector 36 is an optical delay line. In another embodiment, the phase corrector 
36 consists of non-linear voltage activated transmissive optics (controlled via a 
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sensor feedback loop) that alter the optical path length of the light 32. The phase 
corrector 36 may also be required to correct optical aberrations and misalignments 
that may exist for the lens elements 24. An Optical Volumetnc 

Reducing Process (OVRP) is implemented to reduce the exiting light bundles 32 
from the lens elements 24 into an area much smaller than the size of the array 26. 
In one embodiment of the present invention, the OVRP is a two-step process that 
compacts the exiting light bundles 32 from the lens elements 24 in the horizontal 
direction and the vertical direction. The light 38 is first passed through the 
horizontal OVRP 40, then the light bundles 42 exiting the horizontal OVRP 40 are 
passed through the vertical OVRP 44. It is understood that in another embodunent 
of the present invention the vertical OVRP 44 can precede the horizontal OVRP 
40 The horizontal OVRP 40 uses optical elements 46 held by support structure 
48 to reduce the length of the exiting bundles in the horizontal direction. The 
vertical OVRP 44 uses optical elements 50 helped by support structure 52 to 
reduce the length of the exiting bundles in the vertical direction. 

FIG. 4a illustrates a top view of the positioning of two neighboring 
optical elements 46 in the horizontal OVRP 40 to reduce the horizontal dimension 
from a distance 2d+(d-d') to a distance 2d'. In this embodiment, the optical 
elements 46 of the horizontal OVRP 40 are reflective optical flats. FIG. 4b 
illustrates a side view of the positioning of two neighboring optical elements 50 in 
the vertical OVRP 44 to reduce the horizontal dimension from a distance 2d + (d- 
d') to a distance 2d'. In this embodiment, the optical elements 50 in the vertical 
OVRP 44 are also reflective optical flats. 

FIG 5 illustrates the reduction of the area covering the exiting light 
> bu ndle S 32usingahorizontalOVRP40andaverticalOVRP44. Ifthereisno 
gaP between the lens elements 24 in the horizontal and vertical direction, then the 
square array 26 of N number lens elements 24, each of diameter d, covers an area 
[Nd]x[Nd]. Thediameterd' of each exiting light bundle 32 is smaller than the 
entrance aperture diameter d of the lens element 24. In one embodiment, the 
0 phase corrector 36 does not modify the diameter of the exiting light bundles 32 or 
the spacing between the exiting light bundles 32, thus the area 54 of the light 
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bm d 1 es3 8 en,enn g «hehorizo„ t a 1 OVRP40istNd-(d-d.)]x t Nd-(d- d -)].-n.e 
horizontal OVRP 40 reduces ,he horizontal dimension from a distance Nd to a 
distance Nd'. Consequently, the area 56 of the light bnndles 42 entering the 
vertical OVRP 44 is [N^W)]. The vertical OVRP 44 rednces the 
vertical dimension from a drstance Nd to a distance Nd' such that the area 60 of 
th e Unbundles 58 exiting the vertical OVRP 44 i, WW. The tight 
bundles 58 exiting the vertical OVRP 44 are imaged by the beam combiner 
shown in FIG. 2. The beam combiner 62 is a means for combining all me extttng 
tight bundles 58 from the array of lens elements 26 to form an image wtlh 
resolution comparable ,o a single aperture having at equivalent aperture , » 
respective to .he array of lens Cements 26. The image is recorded on a detector 64 
(as shown in FIG. 2). The de.ec.or 64 can be any media capable of record.ng 

U8ht The honzontal OVRP 40 and the vertical OVRP 44 reduce the size 

; „f ,he beam combiner 62 necessary and allow .he imaging system 30 of tite 

resent invention .o be compact in volume. The beam combiner 62 can be located 
behind me array 26 ,o reduce overall widUt or beside me array 26 .0 reduce overall 
depth. FIGS. 6a and 6b illustrate one embodiment of the present — ma 
oses a horizontal OVRP 40 and .he vertical OVRP 44 ,0 minimize me depth of the 
■0 imaging system 30. FIG. 6a is a schematic top v,ew of the imaging system 30 and 
FIG 6b is a schematic front v,cw of the imagmg system 30. The interaction 
between each of the numbered parts in FIG. 6a and FIG. 6b is the same as 
described for FIG. 2. The array 26 of lens elements 24 can be constructed such 
tha. i. can be folded for mrther compactness when .he entire array 26 of lens 
25 elements 24 is not being used for imaging. 

In summary, a multiple aperture imaging system has been mven.ed 
,ha. uses an array of multiple lens elements to form an image with higher 
resolution than possible with each individual lens element; potentially .he 
resolution will correspond to an aperture equivalent to the size of the array. The 
30 invention is des.gned to form a compact imaging system by reducing the overall 
volume of the captured light. 



The invention has been described with reference to one 
embodiment. However, i, is nnderstood that a person of ordinary skill in the m 
« effect variations and modifications without departing ftom the scope of the 
invention. 



-9- 



PARTS LIST: 



24 lens element 

26 array of lens elements 

28 light entering lens element 

30 imaging system 

32 light exiting lens element 

34 plurality of lenses comprising a lens element 

36 optical phase corrector 

38 light entering the horizontal OVRP 

40 horizontal OVRP 

42 light entering the vertical OVRP 

44 vertical OVRP 

46 optical elements comprising the horizontal OVRP 

48 horizontal OVRP support structure 

50 optical elements comprising the vertical OVRP 

52 vertical OVRP support structure 

54 area of the light bundles entering the horizontal OVRP 

56 area of the light bundles entering the vertical OVRP 

58 light exiting the vertical OVRP 

60 area of the light bundles exiting the vertical OVRP 

62 beam combiner 

64 detector 



